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IT. AMENDMENTS TO THE SUBSTITUTE SPECIFICATION. 
1. At page 1 of the CIF Replacement Application 

Title Title 

An Apparatus and Method And Techniques for Measuring and Correlating 
Characteristics of Fruit With Visible/Near Infra-Red Spectrum 

C o n t inuation In Tart Ap p Hcation -Cootinuation In Part Application 
This is a Continuation In Part Application copending from the nonprovisional 
parent application 09/524,329 entitled AN APPARATUS AND METHOD FOR 
MEASURING AND CORRELATING CHARACTERISTICS OF FRUIT WITH 
VISIBLE/NEAR INFRA-RED SPECTRUM to Ozanich as filed March 13, 2000. The 
applicant requests prosecution pursuant to 37 C.F.R. 1.53(b) and 1.78 and 35 U.S.C. 120. 
New matter herein is added, for examination convenience, commencing with page 56 
which follows die last line of the Detailed Description of the original application and 
precedes the claims. 

F ield o f the Invention Field of the Invention 
The present disclosure relates generally to the use of the combined visible and 
near infra red spectrum in an apparatus and method for measuring physical parameters, 
e.g., firmness, density and internal and external disorders, and chemical parameters, e.g., 
molecules containing O-H, N-H and C-H chemical bonds, in fruit and correlating the 
resulting measurements with fruit quality and maturity characteristics, including Brix, 
acidity, density, pH, firmness, color and internal and external defects to forecast 
consumer preferences including taste preferences and appearance, as well as harvest, 
storage and shipping variables. With the present apparatus and method, the interior of a 

Application No. 09/804,613 
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sample, e.g., fruit including apples, is illuminated and the spectrum of absorbed and 
scattered light from the sample is detected and measured. Prediction, calibration and 
classification algorithms are determined for the category of sample permitting correlation 
between the spectrum of absorbed and scattered light and sample characteristics, e.g., 
frtrtt-fruit q uality and 


1 
2 
3 
4 
5 
6 
7 
8 
9 

10 2. At nape 2 of the CIP Replacement Ap plication; 
X1 R:iLk t; i uund nr Ilia Iiiv c iiti o n ftwJr pmnid of the Invention 

12 The embodiments disclosed herein has a focus on combined visible and near-infrared 

13 (NIR) spectroscopy and its modes of use, major issues in the application of NIR to the 

14 measurement of 0-H,N-H and C-H containing molecules that are indicators of sample 

1 5 quality including fruit quality and in particular free fruit quality. 

16 Nui - Iufi m id Sye tl i u i c uyj Dfl t k&i o und: Near-Infrared Spectroscopy Background; 

17 Near-infrared spectroscopy has been used since the 1970's for the compositional analysis 

18 of low moisture food products. However, only in the last 10-15 years has NIR been 

19 successfully applied to the analysis of high moisture products such as fruit. NIR is a form 

20 of vibrational spectroscopy that is particularly sensitive to the presence of molecules 
21 1 containing C-H (carbon-hydrogen), O-H (oxygen-hydrogen), andN-H (nitrogen- 
hydrogen) groups. Therefore, constituents such as sugars and starch (C-H), moisture, 
alcohols and acids (O-H), and protein (N-H) can be quantified in liquids, solids and 
slurries. In addition, the analysis of gases (e.g., water vapor, ammonia) is possible. NIR 
is not a trace analysis technique and it is generally used for measuring components that 
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1 II are present at concentrations greater than 0.1%. 

2 I 3Lui t V i r .i i lIlu^H i tt T ■. ■ ■ ^Wj . i. p i p n^ i i i wn: Short-Wavelength NTR vs. Long- 

3 II Wavelength NIR:_N IR has traditionally been carried out in the 1 1 00-2500 nm region of 

4 the electromagnetic spectrum. However, the wavelength region of -700-1 100 nm (short 


wavetength-NIR or SW-NIR) has been gaining increased attention. The SW-NIR region 
offers numerous advantages for on-line and in-situ bulk constituent analysis. This portion 
of the NTR is accessible to low-cost, high performance silicon detectors and fiber optics. 
In addition, high intensity laser diodes and low-cost light emitting diodes are becoming 
increasingly available at a variety of NDR wavelength outputs. 


5 
6 

7 

8 
9 
10 
11 
12 
13 

14 transformation and some type of spectral normalization. All of these methods for relating 

15 MR spectra to chemical or physical properties are well known to those practiced in the 

16 II art of NTR spectroscopy. 

!7 II The fujicgoiug pal u uto and point e d publiuUi u u& aii yiovid i d liuiwilh in an 

18 fcr E oimati o u Disclosure SUttmcnt in anordauii with 37 CTR 1-97: 


3. At page 7 of the CIP Replacement Application; 


19 

20 
21 
22 
23 
24 
25 
26 
27 
23 


Sm i miai » nf ilia timeirthm- Summary of the Invention 
Research groups around the world continue to explore the applications of neat infrared 
spectroscopy to tree fruit. The apparatus and process disclosed herein is of 


4. At page 11 of the CIP R eplacement Application; 

Disclosed herein is an apparatus and method for measurement, with the 
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visible/toear-infrared (VIS/NIR) spectroscopic technique for sugar content (also known as 
Brix or soluble solids, which is inversely related to dry matter content), firmness, acidity, 
density, pH, color and internal and external defects and disorders. The apparatus and 
method is successful in measuring one or more such characteristic in apples, grapes, 
oranges, potatoes and cherries. Demonstrated in this disclosure is the ability to combine 
chemical and physical property data permitting the prediction of consumer properties, 
such as taste, appearance and color; harvest variables, such as time for harvest; and 
storage variables such as prediction of firmness retention and time until spoilage. 
Pi i e f D e scripti o n of th e Drawing s- Brief Description of th e Drawings 
The foregoing and other features and advantages of the present disclosure will 
become more readily appreciated as the same become better understood by reference to 
the following detailed description of the preferred embodiment and additional 
embodiments of the disclosure when taken in conjunction with the accompanying 
drawings, wherein: 

S. At page 19 of the CTP Replacem ent Application: 

illuminate the sample(s) 30 with detectors 80 receiving input with light detector output 82 
conveyed as input to spectrometers 170 detectors 200. In this illustration a lens 130 is depicted 
between the sample 30 and the detector 80. Illustrations 1 5 and 1 5 A depict in detail, with filter 
130 and mounting means, a single detector 80. 

A CPU 172, controlled by computer program, is not depicted in Fig. 10, 10A, 11, 12, 13, 14, 
14A, 15 or 15A as a person of ordinary skill will appreciate such structure from viewing other 
drawings presented herein. 

Detailed D i t&aiplioii Detailed Description 
The apparatus and method disclosed herein is illustrated in Fig. 1 through 8. Fig. 

Certifica^of facsimilej5Jing^ Application No. 09/804,613 
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1C, ID, IE and IF are flow diagrams demonstrating the method of this invention. The 
flow diagram Fig. 1C is representative of all embodiments of this disclosure. The flow 
diagram Fig. ID illustrates one or more light sources 120 and multiple channels from 
fight detector 50 through final prediction of sample characteristic. Fig. ID demonstrates 
the method and apparatus of this disclosure illustrating the light sources) 120, which may 
be lamps 123 or other light sources, which illuminate a sample 30 interior 36, light 
collection channels 1 ...n, composed for example of fiber optic fibers 80 or photodetectors 
255, e.g., light detector 1 ...n, of the spectra from a sample 30 delivered as input 82 to a 
spectra measuring device, shown here as spectrometers) 1 ...n. 170. In the preferred 
embodiment a light source 120 with lamp 123 is external to the spectrometer and is 
controlled by a CPU 172 which triggers power 125 to the fight source 120 lamp 123. 
Spectrometer 1 ...n 170 channels output 1 ...n are converted from analog to digital by A/D 
converters l...n 171 and become, for each channel, input to a CPU 172. The CPU 172 is 
computer program controlled with each step, following the CPU 172 in this flow diagram 
is representative of a computer program controlled activity. A CPU 172 output is 
provided for each channel l....n where the steps of 1) calculation of absorbance spectra 
173 occurs for each channel l...n, 2) combine absorbance spectra 174 into a single 
spectrum encompassing the entire wavelength range detected from the sample by 
spectrometers 1 ...n 170, 3) mathematical preprocessing or preprocess 175, e.g., 


^ At page 54 of the CIP Replacemen t Application: 


120 and the sample, provided, for example by a linear polarization filter or an equivalent 
as understood by one of ordinary skill in the art; a matching polarization filter is 
positioned between the at least one illumination detector and the sample, which may be 
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provided, for example by a linear polarization filter rotated 90 degrees in relation to the 
polarization filter between the light source 120 and the sample. 

The method described above, which uses wavelengths of both visible radiation 
(250-699 ran) specifically chosen to include the absorption band for yellow color 
pigments (250-499nm), red color pigments (500-600 ran) and green pigments or 
chlorophyll (601-699 nm), as well as NDR (700-1 1 50 nm) radiation to correlate with Brix, 
firmness, pH, acidity, density, color and internal and external defects can be carried out 
using a variety of apparatuses. 

AMmTIONAL T wr-HT ^P PTSSCMPHON A nDTTTON AL DETATT.F.D DESCRIPTION 


Ovr i viMV of t iilihrati o n ir f tisil i l i L/NlP mjuhw; Overview of caffl»ration_of 


visihle/NlR sensors: 


Required calibration was addressed in the Parent Application 09/524,329, in paragraphs, 
identified by page/line by pn/ln, as follows: 1/18; 3/17, 22, 28; 4/2; 8/8; 9/4; 9/14; 12/16; 
1678; 22/5; 31/21; 33/19; 39/10; 43/4; 47/1; 52/13 etc. Calibration of spectroscopic 
maturity and quality sensors involves building algorithms that relate the visible and near 
tn&ared spectrum of an individual fruit or vegetable to one or more of the following: Brix 
(including, but not limited to sugar content, or sweetness, or soluble solids content); 
acidity (including but not limited to total acidity, or sourness, or malic acid content or 
citric acid content or tartaric acid content); pH; 


7. At page 55 of the CIP Replacement Application: 
IuH.yu>tIutt t i Uilil e /NIR^ nmn 'villi uiiikimuaor 


»iuliioniriug < ^ t ^^ UU »itu»n with modue i InLJilinn/iiuniliim t» opliuii^_yjlk£!i5a 
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of aitni p le da t a, and r efe r ence and s t anda r diza tio n -d ata ; 

Integrating visible/NIR sensors with packing, sorting and conveyance systems and 
synchronizing data acquisition with product location/position to optimize collection of 
sample data, and reference and standardization data. 

Sensing sample data including the presence or absence of a sample was addressed in the 
parent in paragraphs, identified by page/line by pn/ln, as follows: 20/20; 36/8 etc. Using 
spectroscopic sensors for measuring fruits and vegetables while in motion on a sample 
conveyor 295 system in sorting and packing warehouses is illustrated in Fig. 10 and Fig. 
10A and is done as follows: The presence or absence of a sample 30 and the 
position/location of the sample 30 relative to the point of spectrum measurement is 
determined using one or more of the following means: 1) sample 30 position 
determination means and or sample conveyor 295 position determination means, 
provided for example by an encoder or pulse generator 330, as 


8. At page 56 of the CIP Replacement Application; 

0b t aining,a specti " »'» o f th e lam p fs^ f or d e termining r e f ere nc e light o n tp u t an d 
ubtatulim bm t iliiii Jji k mi i tut m e i.li a fi um d c l e tl o rto. Bulk i tfu eli te and dark 
su e ctra - A re us e d with &amult au c cUum tu calc ulate the pioducfs absmbance 
suGCtrnn ir- 

Ohtaininp a spectrum of the lamp<s)_fot^deteTminmg reference light output and obtaining 
baseline dark current spectra from dete ctorfsV Both reference and dark spectra are.u&ed 


Certificate/ff facsimile filing. Application No. 09/804,613 
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x ll ^th M mple gPffftrpm to calcul ^ tha product's abSQThfrnce sr^txum,. 

2 II Reference to reference, baseline and dark spectra was addressed in the parent in 

3 || paragraphs, identified by page/line by pn/ln, as follows: 12/18; 39/10; 52/14 etc. Hie 

4 II reference measurements to account for changes in light source intensity or color output 

5 || can be obtained using a reference light transmission means 320, e.g., a fibet-optic bundle 

6 II which may be furcated, a light pipe or other means of transmitting light, with a common 

7 end 322 providing input to a reference spectrometer 170, and, where 

8 
9 
10 

H | o 1 xt pa ges 6<v<a «t the CIP Re placement Application; 
12 

13 A CPU 172, controlled by computer program, is not depicted in Fig. 10, 10A, 1 1, 12 or 

14 13 as a person of ordinary skill will appreciate such structure from viewing other 

15 drawings presented herein. 
II , i r . . . nana u.wMuiLumU f i i»T i 1 ii M iij.tun ■ n ■■■ * llllL 10 UujM *t6 

16 

17 I TBSSMSSSSSSS& 
19 n^easurementy 

2 0 To improve the measurement of the entire product, two or more light sources 120 lamps 

21 123 and/or detection 80 points are used. The product can be measured rolling or not 

22 rolling with a rolling measurement generally improving whole product measurement, 

23 while a non-rolling measurement provides better accuracy and introduces less spectral 

24 noise due to movement, 

25 As a single fruit or vegetable sample 30 passes by the point of spectrum acquisition, 

26 " facsimile fijjng _ Application No. 09/804,613 

27 " 

28 


Serial ' 



iSPTO 35 


04M»FINAXITUWVI0«0S.wp<J 


JUN.08'2004 11:22 5097353585 


LIEBLER, IVEY & CONNOR 


#5628 P. 012 


1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 


multiple spectra are acquired, each spectrum representing a different measurement 
location or area on the product. 

OptimlLiuu Mtfi i aMtMi o fce and amirw -i milli small and tome Akfc Product, 


Opti^T^p; si pnal-to-noise and accuracy with small and large size -product. One or more 


means may be used to determine the size or weight of the individual fruit or vegetable 
sample 30. Means for deteiraining product size includes, but is not limited to 1) a 
separately determined weight or mass using sensors common to the industry, 2) utilizing 
the color sorter or defect sorter data (e.g., from camera or CCD images), 3) utilizing other 
size sensors based on magnetic, inductive, light reflectance or multiple light beam 
curtains, common to other industries. The relative size of the sample 30 can then be used 
to adjust the hardware spectrum acquisition parameters or the amount of light (by varying 
the aperture 310 size) to provide an improved signal-to-noise ratio spectrum for large 
samples 30 and/or to prevent detector 80 saturation by light for small product sample 30, 
e.g., detector 80 exposure or integration time can be set for longer time periods for large 
product samples 30 and for shorter time periods for small product. 
Im pimiuM au .ui am Ijv in *|iiLiiuii o f rmi Ulpli individual autUia coUecttd from a 



sample. 


Improving accuracy bv inspection of multi p le individual spectra collected from a single 


product and removing noor quality or "outlier" snectra. Then, calculating the absorbance 


spectrum from the raw dat a collected for dark, reference and Sample, 


Each individual spectrum from the series of spectra acquired for each individual product 
sample 30 are then inspected by a computer program or programmed hardware. Poor 
quality spectra are deleted from this batch of spectra and the remaining spectra are used 
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for constituent or property prediction. The retained spectra of the product axe combined 
with the appropriate reference and dark current measurements to produce an absorbance 
spectrum as follows: 

Absorbance Spectrum = -loglO [(sample intensity spectrum- sample dark current 
spectrum) / (reference intensity spectrum - reference dark current spectrum)] i.e. the 
absorbance spectrum is equal to the negative logarithm (base 10) of the ratio of the dark 
current corrected sample spectrum to the dark current corrected reference spectrum. 
All of the absorbance spectra for each product sample 30 can then be combined to 
produce a mean or average absorbance spectrum of the product sample. This average 
absorbance spectra can then be used to compute the component or property of interest 

11 I based on a previously stored calibration algorithm. Altemativery, each absorbance 

12 spectrum can be used individually with a previously stored calibration algorithm to 

13 compute multiple results of the component or property of interest for an individual 

14 product, followed by determmation of the average or mean component or property value 

15 computed by summing all of the values and dividing the resultant sum by the number of 

16 absorbance spectra used. 



rrffrH- .t n i th llm su mi, lituiQuu that mill bt i 
h y-the lab or atory e f erc nc c technique: 

20 Method for m easuring samp les and importance of linking location on , product wAere . 

21 visih1e/NIR data was collected with the s ame location that will be measured by the 
laborator y referen ce technique.. 

Calibration is performed as follows: 1) Spectra of product sample 30 are measured and 

24 | absorbance spectra (corrected for reference and dark current) are stored, 2) Standard 

25 laboratory measurements (which are often destructive) are made on the product sample 
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30. Note: it is important to the success of the NIR method that the portion of the sample 
30 that is interrogated between the light source(s) 120 lamps 123 and Ught collection^) 
detectors, e.g., light detectors 80, leading to the spectrometers) 170 detectors 200 is the 
same as that portion measured by the standard laboratory technique. 
For many sample conveyors 295 that are used for whole fruit and vegetable sorting and 
packing operations, the product can be transported past the NCR. measurement location 
rolling or not rolling. If absorbance spectra are collected from the product as it is rolling, 
the exact location of any one measurement (one spectrum) is not usually known, and 
therefore the entire product (as opposed to one localized spot) must be analyzed for the 
component or property of interest. If calibration algorithms are constructed in this way 
(using measurements of rolling product), all of the retained spectra for that individual 
product are averaged to produce an average absorbance spectrum and the total product 
component or property is assigned to this one absorbance spectrum. 
Because most fruits and vegetable are heterogeneous and vary in component level with 
location, it is preferable to develop a calibration model on product sample 30 that is not 
rolling so that each acquired spectrum is from a known physical location on the product 
sample 30. Then, laboratory measurements are made on the same portion of product 
sample 30 that spectra were taken from. When this procedure is used, a whole fruit or 
vegetable sample 30 maybe separated, e.g., cut or sliced, into smaller sub-portions prior 
to laboratory analysis. These smaller sub-portions each correspond to NIR data collected 
over the same locations within the product sample 30; the time period of NIR data 
acquisition can be adjusted to shorter or longer times, corresponding to the measurement 
of smaller or larger product samples 30, respectively. In this case, each sub-portion of the 
product sample 30 will have one or more spectra associated with that particular location. 
The laboratory determined component or property is then assigned to each spectrum or 
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spectra from that particular location. 


.n»iu i kJ lijihI .m. i UMa ■iiimiaUuu model building 


y^tid r,roc~«™ j, nerformed on absorbance spectra prior to conducting 


mi stical cofrei^nn analysis * »H cnliHmtion model building. 


Absorbance spectra are pre-processed using a bin and smooth function. Partial least 
squares analysis (or variants thereof such as piecewise direct standardization) are then 
used to relate the processed absorbance spectrum to the assigned component and property 
values such as Brix, acidity, P H, firmness, color, internal or external disorder severity and 
type, and eating quality. 

ni- i. .. . i i . .iuiL.- "f™»'»« "ltd m duTli> | > * * J,ul " ^ ig jgtefe 


MAtl^nd T" minimize 


♦hp number of c am ples needeH tn develop a calibration model. 
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